New Claims: 

What is claimed is: 

17. A security control apparatus for controlling a supply of a service to a user in a service 
area, comprising: 

a monitor unit configured to continuously input images of the service area; 

a recognition unit configured to recognize the user as an authorized user from the 
input images, and to recognize at least one person other than the authorized user from the input 
images; and 

a service control unit configured to supply the service to the authorized user when the 
user is recognized in the input images, and to control the supply of the service to the authorized user 
when the person other than the authorized user is recognized in the input images. 

18. The security control apparatus according to claim 17, wherein said service control 
unit interrupts the supply of the service when the user is not recognized in the input images. 

19. The security control apparatus according to claim 17, wherein said service control 
unit interrupts the supply of the service when the person other than the authorized user is recognized 
in the input images. 

20. The security control apparatus according to claim 17, wherein said service control 
unit decides whether work of the user for the service is completed when the user is not recognized in 
the input images. 

21. The security control apparatus according to claim 20, wherein said service control 
unit finishes the supply of the service if the work of the user for the service is completed, interrupts 
the supply of the service if the work of the user for the service is not completed, and relieves an 
interruption of the supply of the service when the user is recognized in the input images again. 

22. The security control apparatus according to claim 17, wherein said recognition unit 
recognizes the user by referring to a person comparison dictionary to recognize persons allowed to 
use the service. 
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23. The security control apparatus according to claim 17, wherein said recognition unit 
generates a person comparison dictionary to recognize an unspecified person allowed to use the 
service, and recognizes the unspecified person as the user by referring to the person comparison 
dictionary. 

24. The security control apparatus according to claim 17, wherein said service control 
unit sends a warning to the user when the person other than the authorized user is recognized in the 
input images. 

25. The security control apparatus according to claim 24, wherein said service control 
unit controls the supply of the service in accordance with an indication of the user being warned. 

26. The security control apparatus according to claim 17, wherein said service control 
unit controls the supply of the service in accordance with a security degree preset to each kind of the 
service. 

27. The security control apparatus according to claim 17, wherein said service control 
unit detects a movement of the visual line or a direction of the face of the user, and controls the 
supply of the service in accordance with the movement of the visual line or the direction of the face 
of the user. 

28. The security control apparatus according to claim 17, wherein said service control 
unit detects a movement of the visual line or a direction of the face of the nonuser, and controls the 
supply of the service in accordance with the movement of the visual line or the direction of the face 
of the non-user. 

29. A security control apparatus for controlling a supply of a service to a user in a service 
area, comprising: 

a person recognition unit configured to recognize a user requesting the service; 

a use situation decision unit configured to decide whether the user is under a situation 
to use the service in accordance with recognition result of said person recognition unit; 

an intrusion situation decision unit configured to decide whether a non-user intrudes 
into the service area in accordance with recognition result of said person recognition unit; and 
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a service control unit configured to supply the service to the user when said person 
recognition unit recognizes the user, and to control a supply of the service when said use situation 
decision unit decides the user is not under the situation to use the service or when said intrusion 
situation decision unit decides the non-user intrudes into the service area. 

30. The security control apparatus according to claim 29, wherein said service control 
unit interrupts the supply of the service when said use situation decision unit decides the user is not 
under a situation to use the service. 

31. The security control apparatus according to claim 29, wherein said service control 
unit interrupts the supply of the service when said intrusion situation decision unit decides the 
non-user intrudes into the service area. 

32. The security control apparatus according to claim 29, wherein said service control 
unit decides whether work of the user for the service is completed or not when said use situation 
decision unit decides the user is not under the situation to use the service. 

33. The security control apparatus according to claim 32, wherein said service control 
unit finishes the supply of the service if the work of the user for the service is completed, interrupts 
the supply of the service if the work of the user for the service is not completed, and relieves an 
interruption of the supply of the service when said use situation decision unit decides the user is 
under the situation to use the service again. 

34. The security control apparatus according to claim 33, wherein said service control 
unit finishes the supply of the service when said use situation decision unit decides the user is not 
under the situation to use the service within a predetermined time during the interruption of the 
supply of the service. 

35. The security control apparatus according to claim 29, wherein said service control 
unit sends a warning to the user when said intrusion situation decision unit decides the non-user 
intrudes into the service area. 
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36. The security control apparatus according to claim 35, wherein said service control 
unit controls the supply of the service in accordance with an indication of the user being warned. 

37. The security control apparatus according to claim 36, wherein said service control 
unit controls the supply of the service in accordance with predetermined control information in case 
of a non-response of the user within a predetermined time after warning of the intrusion. 

38. A security method for controlling a supply of a service to a user in a service area, 
comprising the steps of: 

continuously inputting images of the service area; 

recognizing the user as an authorized user from the input images; 

recognizing at least one person other than the authorized user from the input images; 

supplying the service to the authorized user when the user is recognized in the input 

images; and 

controlling the supply of the service to the authorized user when the person other than 
the authorized user is recognized in the input images. 

39. A computer readable memory containing computer-readable instructions to control a 
supply of a service to a user in a service area, comprising: 

an instruction unit to continuously input images of the service area; 
an instruction unit to recognize the user as an authorized user from the input images; 
an instruction unit to recognize at least one person other than the authorized user from 
the input images; 

an instruction unit to supply the service to the authorized user when the user is 
recognized in the input images; and 

an instruction unit to control the supply of the service to the authorized user when the 
person other than the authorized user is recognized in the input images. 
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(shown in FIGS. &-10, 12. 14. 16) and necessary 
information may be stored in a memory device as shown in 
FIG. 17. In this case, it is possible mat the memory device 
is applied for each apparatus or content of the memory 
device is transmitted to each apparatus by a commumcaUon 
device. 

A memory can be used to store instructions for perform- 
ing the process described above, such a memory can be a 
CD-ROM. floppy disk hard disk, magnetic tape, semicon- 
ductor memory, and so on. 

Other embodiments of the invention will be apparent to 
those skilled in the art from consideration of the specifica- 
tion and practice of the invention disclosed herein. It is 
intended that the specification and examples be considered 15 
as exemplary only, with the true scope and spirit of the 
invention being indicated by the following claims. 

What is claimed is: 

A security apparatus for a device supplying a service to 
iser in a service use area surrounding the user, comprising: 
igc input means for continuously inputting an image to 
Lonitor the service use area; 
>n discrimination means for continuously recogniz- 
person in the input image, and for registering the 
per\on as a user allowed to use the service if the person 
is refcognized as an authorized user; 
use situation decision means for deciding that the user is 
not under a situation to use the service in case the user 
is Dot recognized in the input image; 
irdmgement situation decision means for deciding that a 
security ofSthe service use area is infringed in case at 
least one person other than the authorized user is 
recognized irrthe input image; and 
service control means for supplying the service to the 35 
authorized userVnd for controlling a supply of the 
service if said use\ituation decision means decides that 
the user is not under the situation to use the service or 
if said irifringemennsituation decision means decides 
that the security of th\ service use area is infringed. 

2. The security apparatus>according to claim 1, wherein 
said service control means finishes the supply of the service 
in case said use situation decision means decides the user is 
not under the situation to use the service. 

3. The security apparatus accoiding to claim 1, 
wherein said service control means interrupts the supply 

of the service until the irtfrWement situation is 
relieved in case said infringement situation decision 
means decides the security of me\ervice is infringed. 

4. The security apparatus according to. claim 1, 
wherein said service control means decides whether work 

of the user for the service is complete)! or not in case 
said use situation decision means decidei^the user is not 
under the situation to use the service 

5. The security apparatus according to claimVl 
wherein said service control means finishes the^supply of 

the service in case the work of the user for the service 
is completed, interrupts the supply of the servicdin case 
the work of the user for the service is not completed, 
and relieves an interruption of the supply of the sewice 
in case said use situation decision means decidesnhe 
user is under the situation to use the service again 

6. The security apparatus according to claim 1, 
wherein said person oUscrimination means recognizes theVs 

user by referring to a person comparison dictionary to 
recognize persons allowed to use the service. 
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7. The security apparatus according to claim 1, 
wherein said person discrirmnition means generates a 

person comparison dictionar) to recognize unspecified 
users allowed to use the service, and recognizes the 
unspecified person by referring to the person compan- 
ion dictionary while the unspecified person is a user. 

8. Tfte security apparatus accoiding to claim 1. 

whew: in said service control means sends a warping to the 
us& when said infringement situation decision means 
deddes the security of the stirvice is mfringed. 

9. The^ecurity apparatus accoi ding to claim 8. 
whereiasaid service control means controls the supply of 

the seWice in accordance with ah indication of the user 
being warned. 

10. The security apparatus according to claim 1. 
wherein said service control means controls the supply of 

the servide in accordance with security degrees preset 
to a unit of the service or information for the service. 

11. The security apparatus according to claim 1, 
wherein said service control means detects movement of 

the visual line or a direction of the face of the user and 
controls thekupply of the service in accordance with 
the movemen\of the visual line or the direction of the 
face of the us , 

jaratus according to claim 1, 
control means detects movement of 
direction of the face of the non-user 
ipply of the service in accordance 
)f the visual line or the direction of 
jser. 



12. The security 
wherein said servic* 
the visual line or 1 
and controls the 
with the movement 
the face of the 
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13. A security apparatus for a device supplying a service 
to a user, comprising: 
person discrirnination Jrieans for recognizing a user 

requesting the service; 
use situation decision mearJs fcr deciding whether the user 

is under a situation to usfe ihe service; 
infringement situation decision means for detecting 
whether a non-user intrudes into a use area of the 
service to decide whether the service is infringed; and 
service control means for supplying the service to the user 
in case said person discrirnbtaton means recognizes the 
user, and far controlling a supply of the service if said 
use situation decision means tlecides the user is not 
under the situation to use the service or if said infringe- 
ment situation decision means decides that the security 
of the service is infringed, 
wherein said service control means decides whether work 
of the user for the service is completed or not in case 
said use situation decision r leans decides the user is not 
under the situation to use the servic 
wherein said service control means finisnes the supply of 
the service in case the wort of the user for the service 
is completed, interrupts the supply of theXservice in case 
the work of the user for the service is riot completed, 
and relieves an interruption of the supply of the service 
in case said use situation iecision mean s\ decides the 
user is under the situation to use the service again, and 
wherein said service control means finishes the supply of 
the service in case said u:ie situation decision means 
decides the user is not under the situation ti& use the 
service within a predetermined time during tbe inter- 
ruption of the supply of trie service. 
14. A security apparatus for a device supplying a Service 
to a user, comprising: 
person discrimination means for recognizing a User 
requesting the service; 
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use situation decision means for deciding whether the user 
\ is under a situation to use the service; 
infringement situation decision means for detecting 
\ether a non-user intrudes into a use area of the 
service to decide whether the service is infringed; and 
seme* control means for supplying the service to the user 
in case slid person discrimination means recognizes the 
user, andfite controlling a supply of the service if said 
use situadorPdecision means decides the user is not 
under the situatfcm to use the service or if said infringe- 
ment situation decision means decides that the security 
of the service is infringed, 
wherein said service control means sends a warning to the 
user when said infringement situation decision means 
decides the security of theNservice is infringed, 
wherein said service control me>ns controls the supply of 
the service in accordance with an indication of the user 
being warned, and 
wherein said service control means controls the supply of 20 
the service in accordance with predetermined control 
information in case of a non-response oi\jie user within 
a predetermined time after warning of the infringement. 
15. A security method associated with supplyinga service 
to a user in a service use area surrounding the usV. com- 25 
prising the steps of: 

continuously inputting an image to monitor the service 
use area; 

continuously recognizing a person in the input image; 
registering the person as a user allowed to use the service 

if the person is recognized as an authorized user, 
supplying the service to the authorized user; 
deciding that the user is not under a situation to use the 

service in case the user is not recognized in the input 35 

image; 



[ding that a security of the service use area is infringed 
ni case at least one person other than the authorized 
us\ is recognized in the input image; and 
contro\ng the supply of the service if the user is not 
underW situation to use the service or if the security 
of the sWvice use area is infringed. 
16. A computer readable memory containing computer- 
readable mstruetions to supply a scivice to a user in a service 
use area surrounWg the user, canprising: 
instruction meads for causing a computer to continuously 

input an imageNto monitor the service use area; 
instruction means fV causing a computer to continuously 

recognize a j^sonSin the input image; 
instruction means for causing 1 computer to register the 
person as a user allowe\to use the service if the person 
is recognized as an authorized user; 
instruction means for causing^ computer to supply the 

service to the authorized us-: 
instruction means for causing a computer to decide that 
the user is not under a situation^ use the service in 
case the user is not recognited in the input image; 
instruction means for causing a computdrto decide that a 
security of the service use ;irea is infringed in case at 
least one person other than the authored user is 
recognized in the input image; and 
instruction means for causing a computer toN^ritrol a 
supply of the service if the user is not udfcr the 
situation to use the service or if the security hf the 
lervice use area is infringe! 

, * * 
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